feat(claude_agent_sdk): instrument claude agent sdk#16319
feat(claude_agent_sdk): instrument claude agent sdk#16319
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate nicole-cybul/conti/claude-agents-sdk2 (b1b9cf6) with baseline main (084c102) ❌ Test Failures (1 suite)❌ sethttpmeta - 31/32✅ all-disabledTime: ✅ 10.498µs (SLO: <20.000µs 📉 -47.5%) vs baseline: -0.4% Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +5.1% ✅ all-enabledTime: ✅ 41.306µs (SLO: <50.000µs 📉 -17.4%) vs baseline: +3.4% Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ collectipvariant_existsTime: ✅ 40.883µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.2% Memory: ✅ 35.979MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ no-collectipvariantTime: ✅ 40.048µs (SLO: <50.000µs 📉 -19.9%) vs baseline: -0.1% Memory: ✅ 35.979MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.6% ✅ no-useragentvariantTime: ✅ 38.733µs (SLO: <50.000µs 📉 -22.5%) vs baseline: +0.3% Memory: ✅ 35.901MB (SLO: <36.500MB 🟡 -1.6%) vs baseline: +4.3% ✅ obfuscation-no-queryTime: ✅ 40.683µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +0.4% Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ obfuscation-regular-case-explicit-queryTime: ✅ 75.723µs (SLO: <90.000µs 📉 -15.9%) vs baseline: -0.7% Memory: ✅ 36.019MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ obfuscation-regular-case-implicit-queryTime: ✅ 76.558µs (SLO: <90.000µs 📉 -14.9%) vs baseline: ~same Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +4.4% ✅ obfuscation-send-querystring-disabledTime: ✅ 154.426µs (SLO: <170.000µs -9.2%) vs baseline: -0.1% Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.1% ✅ obfuscation-worst-case-explicit-queryTime: ✅ 148.861µs (SLO: <160.000µs -7.0%) vs baseline: -0.1% Memory: ✅ 36.156MB (SLO: <36.500MB 🟡 -0.9%) vs baseline: +5.3% ✅ obfuscation-worst-case-implicit-queryTime: ✅ 154.930µs (SLO: <170.000µs -8.9%) vs baseline: ~same Memory: ✅ 36.078MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ useragentvariant_exists_1Time: ✅ 39.407µs (SLO: <50.000µs 📉 -21.2%) vs baseline: +0.2% Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.7% ✅ useragentvariant_exists_2Time: ✅ 40.487µs (SLO: <50.000µs 📉 -19.0%) vs baseline: ~same Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +5.0% ✅ useragentvariant_exists_3Time: ✅ 39.874µs (SLO: <50.000µs 📉 -20.3%) vs baseline: -0.4% Memory: ✅ 36.078MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ useragentvariant_not_exists_1Time: ✅ 39.496µs (SLO: <50.000µs 📉 -21.0%) vs baseline: +0.5% Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.6% ❌ useragentvariant_not_exists_2Time: ✅ 39.391µs (SLO: <50.000µs 📉 -21.2%) vs baseline: +0.4% Memory: ❌ 36.176MB (SLO: <36.000MB +0.5%) vs baseline: +5.3% 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 104.487µs (SLO: <130.000µs 📉 -19.6%) vs baseline: +4.2% Memory: ✅ 42.920MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.9% ✅ add_inplace_aspectTime: ✅ 102.337µs (SLO: <130.000µs 📉 -21.3%) vs baseline: +1.1% Memory: ✅ 42.880MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.9% ✅ add_inplace_noaspectTime: ✅ 28.364µs (SLO: <40.000µs 📉 -29.1%) vs baseline: +0.6% Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.9% ✅ add_noaspectTime: ✅ 48.987µs (SLO: <70.000µs 📉 -30.0%) vs baseline: +0.3% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ bytearray_aspectTime: ✅ 257.636µs (SLO: <400.000µs 📉 -35.6%) vs baseline: -0.2% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ bytearray_extend_aspectTime: ✅ 644.230µs (SLO: <800.000µs 📉 -19.5%) vs baseline: -0.6% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ bytearray_extend_noaspectTime: ✅ 258.118µs (SLO: <400.000µs 📉 -35.5%) vs baseline: -0.2% Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.9% ✅ bytearray_noaspectTime: ✅ 137.280µs (SLO: <300.000µs 📉 -54.2%) vs baseline: +1.0% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ bytes_aspectTime: ✅ 223.062µs (SLO: <300.000µs 📉 -25.6%) vs baseline: +0.5% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ bytes_noaspectTime: ✅ 133.915µs (SLO: <200.000µs 📉 -33.0%) vs baseline: +0.9% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ bytesio_aspectTime: ✅ 3.855ms (SLO: <5.000ms 📉 -22.9%) vs baseline: ~same Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ bytesio_noaspectTime: ✅ 314.366µs (SLO: <420.000µs 📉 -25.2%) vs baseline: +0.2% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ capitalize_aspectTime: ✅ 89.286µs (SLO: <300.000µs 📉 -70.2%) vs baseline: +0.9% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ capitalize_noaspectTime: ✅ 250.371µs (SLO: <300.000µs 📉 -16.5%) vs baseline: +1.7% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ casefold_aspectTime: ✅ 91.699µs (SLO: <500.000µs 📉 -81.7%) vs baseline: +3.3% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ casefold_noaspectTime: ✅ 301.913µs (SLO: <500.000µs 📉 -39.6%) vs baseline: -1.0% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ decode_aspectTime: ✅ 87.620µs (SLO: <100.000µs 📉 -12.4%) vs baseline: +0.4% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ decode_noaspectTime: ✅ 153.024µs (SLO: <210.000µs 📉 -27.1%) vs baseline: +0.4% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ encode_aspectTime: ✅ 85.226µs (SLO: <200.000µs 📉 -57.4%) vs baseline: +0.1% Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.6% ✅ encode_noaspectTime: ✅ 140.817µs (SLO: <200.000µs 📉 -29.6%) vs baseline: +0.5% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ format_aspectTime: ✅ 14.728ms (SLO: <19.200ms 📉 -23.3%) vs baseline: +0.3% Memory: ✅ 43.077MB (SLO: <43.250MB 🟡 -0.4%) vs baseline: +4.9% ✅ format_map_aspectTime: ✅ 16.481ms (SLO: <21.500ms 📉 -23.3%) vs baseline: ~same Memory: ✅ 43.057MB (SLO: <43.500MB 🟡 -1.0%) vs baseline: +4.8% ✅ format_map_noaspectTime: ✅ 362.856µs (SLO: <500.000µs 📉 -27.4%) vs baseline: -0.5% Memory: ✅ 42.861MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.9% ✅ format_noaspectTime: ✅ 301.467µs (SLO: <500.000µs 📉 -39.7%) vs baseline: -0.2% Memory: ✅ 42.880MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.8% ✅ index_aspectTime: ✅ 123.393µs (SLO: <300.000µs 📉 -58.9%) vs baseline: +0.5% Memory: ✅ 42.939MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +5.0% ✅ index_noaspectTime: ✅ 40.375µs (SLO: <300.000µs 📉 -86.5%) vs baseline: -0.4% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +5.1% ✅ join_aspectTime: ✅ 209.865µs (SLO: <300.000µs 📉 -30.0%) vs baseline: +1.1% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ join_noaspectTime: ✅ 144.735µs (SLO: <300.000µs 📉 -51.8%) vs baseline: +0.6% Memory: ✅ 42.900MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +5.0% ✅ ljust_aspectTime: ✅ 498.378µs (SLO: <700.000µs 📉 -28.8%) vs baseline: -0.9% Memory: ✅ 42.920MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.9% ✅ ljust_noaspectTime: ✅ 256.518µs (SLO: <300.000µs 📉 -14.5%) vs baseline: -0.3% Memory: ✅ 42.880MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.8% ✅ lower_aspectTime: ✅ 297.408µs (SLO: <500.000µs 📉 -40.5%) vs baseline: -0.1% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ lower_noaspectTime: ✅ 230.431µs (SLO: <300.000µs 📉 -23.2%) vs baseline: +0.1% Memory: ✅ 42.880MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.9% ✅ lstrip_aspectTime: ✅ 0.265ms (SLO: <3.000ms 📉 -91.2%) vs baseline: -0.2% Memory: ✅ 42.979MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +5.1% ✅ lstrip_noaspectTime: ✅ 0.194ms (SLO: <3.000ms 📉 -93.5%) vs baseline: 📈 +10.1% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 14.404ms (SLO: <18.750ms 📉 -23.2%) vs baseline: ~same Memory: ✅ 43.136MB (SLO: <43.500MB 🟡 -0.8%) vs baseline: +5.3% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.892ms (SLO: <19.350ms 📉 -23.0%) vs baseline: +0.2% Memory: ✅ 43.037MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +4.8% ✅ modulo_aspect_for_bytesTime: ✅ 14.519ms (SLO: <18.900ms 📉 -23.2%) vs baseline: ~same Memory: ✅ 43.116MB (SLO: <43.500MB 🟡 -0.9%) vs baseline: +4.9% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.735ms (SLO: <19.150ms 📉 -23.1%) vs baseline: +0.3% Memory: ✅ 43.077MB (SLO: <43.500MB 🟡 -1.0%) vs baseline: +4.8% ✅ modulo_noaspectTime: ✅ 0.354ms (SLO: <3.000ms 📉 -88.2%) vs baseline: -1.1% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +5.0% ✅ replace_aspectTime: ✅ 18.455ms (SLO: <24.000ms 📉 -23.1%) vs baseline: -0.4% Memory: ✅ 43.116MB (SLO: <44.000MB -2.0%) vs baseline: +5.0% ✅ replace_noaspectTime: ✅ 281.641µs (SLO: <300.000µs -6.1%) vs baseline: +0.5% Memory: ✅ 42.841MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ repr_aspectTime: ✅ 314.306µs (SLO: <420.000µs 📉 -25.2%) vs baseline: -0.4% Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.8% ✅ repr_noaspectTime: ✅ 46.985µs (SLO: <90.000µs 📉 -47.8%) vs baseline: +0.5% Memory: ✅ 42.841MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.7% ✅ rstrip_aspectTime: ✅ 381.719µs (SLO: <500.000µs 📉 -23.7%) vs baseline: -0.2% Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ rstrip_noaspectTime: ✅ 181.518µs (SLO: <300.000µs 📉 -39.5%) vs baseline: -1.2% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ slice_aspectTime: ✅ 190.654µs (SLO: <300.000µs 📉 -36.4%) vs baseline: +4.0% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ slice_noaspectTime: ✅ 53.705µs (SLO: <90.000µs 📉 -40.3%) vs baseline: -1.1% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ stringio_aspectTime: ✅ 3.883ms (SLO: <5.000ms 📉 -22.3%) vs baseline: -0.7% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ stringio_noaspectTime: ✅ 344.719µs (SLO: <500.000µs 📉 -31.1%) vs baseline: +0.2% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ strip_aspectTime: ✅ 265.197µs (SLO: <350.000µs 📉 -24.2%) vs baseline: -1.3% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8% ✅ strip_noaspectTime: ✅ 177.620µs (SLO: <240.000µs 📉 -26.0%) vs baseline: +0.5% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7% ✅ swapcase_aspectTime: ✅ 332.530µs (SLO: <500.000µs 📉 -33.5%) vs baseline: -0.3% Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ swapcase_noaspectTime: ✅ 265.357µs (SLO: <400.000µs 📉 -33.7%) vs baseline: -0.9% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ title_aspectTime: ✅ 328.706µs (SLO: <500.000µs 📉 -34.3%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8% ✅ title_noaspectTime: ✅ 254.162µs (SLO: <400.000µs 📉 -36.5%) vs baseline: +0.2% Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 493.021µs (SLO: <700.000µs 📉 -29.6%) vs baseline: -0.8% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ translate_noaspectTime: ✅ 419.683µs (SLO: <500.000µs 📉 -16.1%) vs baseline: -0.6% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ upper_aspectTime: ✅ 296.502µs (SLO: <500.000µs 📉 -40.7%) vs baseline: -0.3% Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ upper_noaspectTime: ✅ 228.461µs (SLO: <400.000µs 📉 -42.9%) vs baseline: -0.8% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 513.431µs (SLO: <700.000µs 📉 -26.7%) vs baseline: 📈 +21.8% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +5.0% ✅ ospathbasename_noaspectTime: ✅ 423.238µs (SLO: <700.000µs 📉 -39.5%) vs baseline: +0.7% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ ospathjoin_aspectTime: ✅ 607.198µs (SLO: <700.000µs 📉 -13.3%) vs baseline: +0.7% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.7% ✅ ospathjoin_noaspectTime: ✅ 614.701µs (SLO: <700.000µs 📉 -12.2%) vs baseline: +0.4% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ ospathnormcase_aspectTime: ✅ 346.349µs (SLO: <700.000µs 📉 -50.5%) vs baseline: -1.1% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7% ✅ ospathnormcase_noaspectTime: ✅ 353.407µs (SLO: <700.000µs 📉 -49.5%) vs baseline: +0.1% Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ ospathsplit_aspectTime: ✅ 488.238µs (SLO: <700.000µs 📉 -30.3%) vs baseline: +0.7% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6% ✅ ospathsplit_noaspectTime: ✅ 495.792µs (SLO: <700.000µs 📉 -29.2%) vs baseline: +0.7% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7% ✅ ospathsplitdrive_aspectTime: ✅ 370.731µs (SLO: <700.000µs 📉 -47.0%) vs baseline: -0.4% Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8% ✅ ospathsplitdrive_noaspectTime: ✅ 73.159µs (SLO: <700.000µs 📉 -89.5%) vs baseline: -0.2% Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0% ✅ ospathsplitext_aspectTime: ✅ 460.549µs (SLO: <700.000µs 📉 -34.2%) vs baseline: -0.4% Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.7% ✅ ospathsplitext_noaspectTime: ✅ 471.545µs (SLO: <700.000µs 📉 -32.6%) vs baseline: +1.3% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7% 🟡 Near SLO Breach (13 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 19.661ms (SLO: <22.300ms 📉 -11.8%) vs baseline: +0.6% Memory: ✅ 68.813MB (SLO: <70.500MB -2.4%) vs baseline: +4.9% ✅ exception-replay-enabledTime: ✅ 1.379ms (SLO: <1.450ms -4.9%) vs baseline: ~same Memory: ✅ 66.831MB (SLO: <67.500MB 🟡 -1.0%) vs baseline: +4.9% ✅ iastTime: ✅ 19.568ms (SLO: <22.250ms 📉 -12.1%) vs baseline: -0.4% Memory: ✅ 68.734MB (SLO: <71.000MB -3.2%) vs baseline: +4.9% ✅ profilerTime: ✅ 15.239ms (SLO: <16.550ms -7.9%) vs baseline: +0.3% Memory: ✅ 56.934MB (SLO: <57.500MB 🟡 -1.0%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 19.610ms (SLO: <21.750ms -9.8%) vs baseline: +0.2% Memory: ✅ 68.695MB (SLO: <70.500MB -2.6%) vs baseline: +4.7% ✅ span-code-originTime: ✅ 20.192ms (SLO: <28.200ms 📉 -28.4%) vs baseline: +2.3% Memory: ✅ 68.667MB (SLO: <71.000MB -3.3%) vs baseline: +4.8% ✅ tracerTime: ✅ 19.567ms (SLO: <21.750ms 📉 -10.0%) vs baseline: +0.2% Memory: ✅ 68.695MB (SLO: <71.000MB -3.2%) vs baseline: +4.8% ✅ tracer-and-profilerTime: ✅ 21.666ms (SLO: <23.500ms -7.8%) vs baseline: ~same Memory: ✅ 70.268MB (SLO: <71.000MB 🟡 -1.0%) vs baseline: +5.0% ✅ tracer-dont-create-db-spansTime: ✅ 19.734ms (SLO: <21.500ms -8.2%) vs baseline: ~same Memory: ✅ 68.734MB (SLO: <71.000MB -3.2%) vs baseline: +4.9% ✅ tracer-minimalTime: ✅ 16.749ms (SLO: <17.500ms -4.3%) vs baseline: -0.3% Memory: ✅ 68.773MB (SLO: <71.000MB -3.1%) vs baseline: +4.9% ✅ tracer-nativeTime: ✅ 19.509ms (SLO: <21.750ms 📉 -10.3%) vs baseline: +0.3% Memory: ✅ 68.773MB (SLO: <72.500MB -5.1%) vs baseline: +4.8% ✅ tracer-no-cachesTime: ✅ 17.664ms (SLO: <19.650ms 📉 -10.1%) vs baseline: -0.3% Memory: ✅ 68.714MB (SLO: <71.000MB -3.2%) vs baseline: +4.8% ✅ tracer-no-databasesTime: ✅ 19.172ms (SLO: <20.100ms -4.6%) vs baseline: ~same Memory: ✅ 68.793MB (SLO: <71.000MB -3.1%) vs baseline: +4.9% ✅ tracer-no-middlewareTime: ✅ 19.305ms (SLO: <21.500ms 📉 -10.2%) vs baseline: -0.1% Memory: ✅ 68.616MB (SLO: <71.000MB -3.4%) vs baseline: +4.6% ✅ tracer-no-templatesTime: ✅ 19.690ms (SLO: <22.000ms 📉 -10.5%) vs baseline: +1.3% Memory: ✅ 68.734MB (SLO: <70.500MB -2.5%) vs baseline: +4.8% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 16.353ms (SLO: <19.850ms 📉 -17.6%) vs baseline: -0.3% Memory: ✅ 70.283MB (SLO: <71.000MB 🟡 -1.0%) vs baseline: +4.8% ✅ errortracking-enabled-userTime: ✅ 16.363ms (SLO: <19.400ms 📉 -15.7%) vs baseline: +0.2% Memory: ✅ 70.386MB (SLO: <71.000MB 🟡 -0.9%) vs baseline: +5.0% ✅ tracer-enabledTime: ✅ 16.333ms (SLO: <19.450ms 📉 -16.0%) vs baseline: -0.3% Memory: ✅ 70.348MB (SLO: <71.000MB 🟡 -0.9%) vs baseline: +4.9% 🟡 errortrackingflasksqli - 6/6✅ errortracking-enabled-allTime: ✅ 2.088ms (SLO: <2.300ms -9.2%) vs baseline: +0.1% Memory: ✅ 56.289MB (SLO: <56.500MB 🟡 -0.4%) vs baseline: +4.9% ✅ errortracking-enabled-userTime: ✅ 2.097ms (SLO: <2.250ms -6.8%) vs baseline: ~same Memory: ✅ 56.210MB (SLO: <56.500MB 🟡 -0.5%) vs baseline: +4.8% ✅ tracer-enabledTime: ✅ 2.088ms (SLO: <2.300ms -9.2%) vs baseline: ~same Memory: ✅ 56.250MB (SLO: <56.500MB 🟡 -0.4%) vs baseline: +4.9% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 3.409ms (SLO: <4.750ms 📉 -28.2%) vs baseline: ~same Memory: ✅ 56.353MB (SLO: <66.500MB 📉 -15.3%) vs baseline: +4.8% ✅ appsec-postTime: ✅ 2.884ms (SLO: <6.750ms 📉 -57.3%) vs baseline: +0.2% Memory: ✅ 56.431MB (SLO: <66.500MB 📉 -15.1%) vs baseline: +4.9% ✅ appsec-telemetryTime: ✅ 3.440ms (SLO: <4.750ms 📉 -27.6%) vs baseline: +0.9% Memory: ✅ 56.292MB (SLO: <66.500MB 📉 -15.4%) vs baseline: +4.8% ✅ debuggerTime: ✅ 1.872ms (SLO: <2.000ms -6.4%) vs baseline: ~same Memory: ✅ 48.274MB (SLO: <49.500MB -2.5%) vs baseline: +4.9% ✅ iast-getTime: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: +0.1% Memory: ✅ 45.362MB (SLO: <49.000MB -7.4%) vs baseline: +4.8% ✅ profilerTime: ✅ 1.897ms (SLO: <2.100ms -9.7%) vs baseline: -0.1% Memory: ✅ 49.294MB (SLO: <50.000MB 🟡 -1.4%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 3.382ms (SLO: <3.650ms -7.3%) vs baseline: -0.4% Memory: ✅ 56.392MB (SLO: <57.000MB 🟡 -1.1%) vs baseline: +4.9% ✅ tracerTime: ✅ 3.398ms (SLO: <3.650ms -6.9%) vs baseline: ~same Memory: ✅ 56.393MB (SLO: <56.500MB 🟡 -0.2%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 3.397ms (SLO: <3.650ms -6.9%) vs baseline: +0.1% Memory: ✅ 56.334MB (SLO: <60.000MB -6.1%) vs baseline: +4.8% 🟡 flasksqli - 6/6✅ appsec-enabledTime: ✅ 2.080ms (SLO: <4.200ms 📉 -50.5%) vs baseline: +0.1% Memory: ✅ 56.250MB (SLO: <66.000MB 📉 -14.8%) vs baseline: +4.9% ✅ iast-enabledTime: ✅ 2.096ms (SLO: <2.800ms 📉 -25.1%) vs baseline: +0.3% Memory: ✅ 56.269MB (SLO: <62.500MB -10.0%) vs baseline: +4.9% ✅ tracer-enabledTime: ✅ 2.080ms (SLO: <2.250ms -7.6%) vs baseline: ~same Memory: ✅ 56.368MB (SLO: <56.500MB 🟡 -0.2%) vs baseline: +5.0% 🟡 httppropagationextract - 60/60✅ all_styles_all_headersTime: ✅ 80.688µs (SLO: <100.000µs 📉 -19.3%) vs baseline: -0.3% Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +4.9% ✅ b3_headersTime: ✅ 14.142µs (SLO: <20.000µs 📉 -29.3%) vs baseline: +0.6% Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.2% ✅ b3_single_headersTime: ✅ 13.264µs (SLO: <20.000µs 📉 -33.7%) vs baseline: +0.4% Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +5.0% ✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_matchTime: ✅ 63.967µs (SLO: <80.000µs 📉 -20.0%) vs baseline: -0.5% Memory: ✅ 35.625MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +5.0% ✅ datadog_tracecontext_tracestate_propagated_on_trace_id_matchTime: ✅ 65.935µs (SLO: <80.000µs 📉 -17.6%) vs baseline: ~same Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +4.0% ✅ empty_headersTime: ✅ 1.606µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.9% Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.7% ✅ full_t_id_datadog_headersTime: ✅ 22.336µs (SLO: <30.000µs 📉 -25.5%) vs baseline: ~same Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.7% ✅ invalid_priority_headerTime: ✅ 6.521µs (SLO: <10.000µs 📉 -34.8%) vs baseline: ~same Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.7% ✅ invalid_span_id_headerTime: ✅ 6.501µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.5% Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.1% ✅ invalid_tags_headerTime: ✅ 6.533µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.4% Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.1% ✅ invalid_trace_id_headerTime: ✅ 6.487µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -0.3% Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +4.6% ✅ large_header_no_matchesTime: ✅ 27.647µs (SLO: <30.000µs -7.8%) vs baseline: ~same Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +4.6% ✅ large_valid_headers_allTime: ✅ 28.791µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +0.2% Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +4.8% ✅ medium_header_no_matchesTime: ✅ 9.844µs (SLO: <20.000µs 📉 -50.8%) vs baseline: +0.9% Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +5.0% ✅ medium_valid_headers_allTime: ✅ 11.262µs (SLO: <20.000µs 📉 -43.7%) vs baseline: -0.7% Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.3% ✅ none_propagation_styleTime: ✅ 1.719µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +0.4% Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +5.0% ✅ tracecontext_headersTime: ✅ 34.731µs (SLO: <40.000µs 📉 -13.2%) vs baseline: -0.1% Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.7% ✅ valid_headers_allTime: ✅ 6.520µs (SLO: <10.000µs 📉 -34.8%) vs baseline: +0.3% Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.1% ✅ valid_headers_basicTime: ✅ 6.095µs (SLO: <10.000µs 📉 -39.1%) vs baseline: +0.4% Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.0% ✅ wsgi_empty_headersTime: ✅ 1.609µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.9% Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +4.9% ✅ wsgi_invalid_priority_headerTime: ✅ 6.563µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.2% Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +5.0% ✅ wsgi_invalid_span_id_headerTime: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +4.9% ✅ wsgi_invalid_tags_headerTime: ✅ 6.556µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.1% Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.3% ✅ wsgi_invalid_trace_id_headerTime: ✅ 6.567µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.1% Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.2% ✅ wsgi_large_header_no_matchesTime: ✅ 28.560µs (SLO: <40.000µs 📉 -28.6%) vs baseline: -0.4% Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.6% ✅ wsgi_large_valid_headers_allTime: ✅ 29.817µs (SLO: <40.000µs 📉 -25.5%) vs baseline: -0.4% Memory: ✅ 35.625MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.9% ✅ wsgi_medium_header_no_matchesTime: ✅ 10.094µs (SLO: <20.000µs 📉 -49.5%) vs baseline: -0.1% Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.6% ✅ wsgi_medium_valid_headers_allTime: ✅ 11.833µs (SLO: <20.000µs 📉 -40.8%) vs baseline: +1.2% Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.8% ✅ wsgi_valid_headers_allTime: ✅ 6.571µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.2% Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +4.4% ✅ wsgi_valid_headers_basicTime: ✅ 6.099µs (SLO: <10.000µs 📉 -39.0%) vs baseline: ~same Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +4.7% 🟡 httppropagationinject - 16/16✅ ids_onlyTime: ✅ 21.875µs (SLO: <30.000µs 📉 -27.1%) vs baseline: +4.3% Memory: ✅ 35.311MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.2% ✅ with_allTime: ✅ 27.664µs (SLO: <40.000µs 📉 -30.8%) vs baseline: -0.7% Memory: ✅ 35.114MB (SLO: <36.000MB -2.5%) vs baseline: +4.8% ✅ with_dd_originTime: ✅ 24.845µs (SLO: <30.000µs 📉 -17.2%) vs baseline: +0.5% Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +5.2% ✅ with_priority_and_originTime: ✅ 24.100µs (SLO: <40.000µs 📉 -39.8%) vs baseline: -0.8% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.6% ✅ with_sampling_priorityTime: ✅ 21.138µs (SLO: <30.000µs 📉 -29.5%) vs baseline: +0.5% Memory: ✅ 35.547MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.7% ✅ with_tagsTime: ✅ 25.940µs (SLO: <40.000µs 📉 -35.2%) vs baseline: +0.4% Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.9% ✅ with_tags_invalidTime: ✅ 27.358µs (SLO: <40.000µs 📉 -31.6%) vs baseline: +0.5% Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +4.9% ✅ with_tags_max_sizeTime: ✅ 26.469µs (SLO: <40.000µs 📉 -33.8%) vs baseline: ~same Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +5.0% 🟡 iast_aspects - 40/40✅ re_expand_aspectTime: ✅ 3.721ms (SLO: <4.880ms 📉 -23.7%) vs baseline: +6.2% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ re_expand_noaspectTime: ✅ 3.471ms (SLO: <4.620ms 📉 -24.9%) vs baseline: +0.2% Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.9% ✅ re_findall_aspectTime: ✅ 336.004µs (SLO: <450.000µs 📉 -25.3%) vs baseline: ~same Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8% ✅ re_findall_noaspectTime: ✅ 321.599µs (SLO: <430.000µs 📉 -25.2%) vs baseline: -0.5% Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.1% ✅ re_finditer_aspectTime: ✅ 451.400µs (SLO: <590.000µs 📉 -23.5%) vs baseline: +0.4% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +5.0% ✅ re_finditer_noaspectTime: ✅ 324.110µs (SLO: <440.000µs 📉 -26.3%) vs baseline: -0.5% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ re_fullmatch_aspectTime: ✅ 276.892µs (SLO: <360.000µs 📉 -23.1%) vs baseline: ~same Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ re_fullmatch_noaspectTime: ✅ 302.707µs (SLO: <400.000µs 📉 -24.3%) vs baseline: -0.6% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ re_group_aspectTime: ✅ 478.915µs (SLO: <630.000µs 📉 -24.0%) vs baseline: +0.5% Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ re_group_noaspectTime: ✅ 482.632µs (SLO: <640.000µs 📉 -24.6%) vs baseline: -0.3% Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.1% ✅ re_groups_aspectTime: ✅ 491.263µs (SLO: <650.000µs 📉 -24.4%) vs baseline: -0.5% Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +5.0% ✅ re_groups_noaspectTime: ✅ 493.133µs (SLO: <650.000µs 📉 -24.1%) vs baseline: -0.4% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ re_match_aspectTime: ✅ 281.653µs (SLO: <370.000µs 📉 -23.9%) vs baseline: ~same Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ re_match_noaspectTime: ✅ 308.852µs (SLO: <410.000µs 📉 -24.7%) vs baseline: +0.4% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.9% ✅ re_search_aspectTime: ✅ 271.307µs (SLO: <350.000µs 📉 -22.5%) vs baseline: +3.3% Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ re_search_noaspectTime: ✅ 281.735µs (SLO: <380.000µs 📉 -25.9%) vs baseline: +0.1% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ re_sub_aspectTime: ✅ 350.093µs (SLO: <460.000µs 📉 -23.9%) vs baseline: -0.7% Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ re_sub_noaspectTime: ✅ 390.610µs (SLO: <520.000µs 📉 -24.9%) vs baseline: -0.8% Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.9% ✅ re_subn_aspectTime: ✅ 369.361µs (SLO: <490.000µs 📉 -24.6%) vs baseline: -0.2% Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ re_subn_noaspectTime: ✅ 402.691µs (SLO: <530.000µs 📉 -24.0%) vs baseline: ~same Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.2% 🟡 ratelimiter - 12/12✅ defaultsTime: ✅ 2.377µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +0.5% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.6% ✅ high_rate_limitTime: ✅ 2.413µs (SLO: <10.000µs 📉 -75.9%) vs baseline: -0.8% Memory: ✅ 35.527MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.9% ✅ long_windowTime: ✅ 2.386µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.5% Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +5.1% ✅ low_rate_limitTime: ✅ 2.380µs (SLO: <10.000µs 📉 -76.2%) vs baseline: ~same Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.8% ✅ no_rate_limitTime: ✅ 0.822µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -0.2% Memory: ✅ 35.488MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.7% ✅ short_windowTime: ✅ 2.512µs (SLO: <10.000µs 📉 -74.9%) vs baseline: +0.3% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.7% 🟡 recursivecomputation - 8/8✅ deepTime: ✅ 309.394ms (SLO: <320.950ms -3.6%) vs baseline: ~same Memory: ✅ 36.313MB (SLO: <36.500MB 🟡 -0.5%) vs baseline: +4.7% ✅ deep-profiledTime: ✅ 324.693ms (SLO: <359.150ms -9.6%) vs baseline: -0.5% Memory: ✅ 40.442MB (SLO: <40.500MB 🟡 -0.1%) vs baseline: +4.8% ✅ mediumTime: ✅ 7.072ms (SLO: <7.400ms -4.4%) vs baseline: ~same Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +5.0% ✅ shallowTime: ✅ 0.968ms (SLO: <1.050ms -7.8%) vs baseline: +1.5% Memory: ✅ 35.527MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.8% 🟡 span - 26/26✅ add-eventTime: ✅ 19.803ms (SLO: <22.500ms 📉 -12.0%) vs baseline: ~same Memory: ✅ 37.368MB (SLO: <53.000MB 📉 -29.5%) vs baseline: +4.9% ✅ add-metricsTime: ✅ 89.206ms (SLO: <93.500ms -4.6%) vs baseline: +0.3% Memory: ✅ 41.486MB (SLO: <53.000MB 📉 -21.7%) vs baseline: +4.6% ✅ add-tagsTime: ✅ 142.843ms (SLO: <155.000ms -7.8%) vs baseline: +0.3% Memory: ✅ 41.500MB (SLO: <53.000MB 📉 -21.7%) vs baseline: +4.7% ✅ get-contextTime: ✅ 17.742ms (SLO: <20.500ms 📉 -13.5%) vs baseline: -0.6% Memory: ✅ 37.177MB (SLO: <53.000MB 📉 -29.9%) vs baseline: +4.8% ✅ is-recordingTime: ✅ 18.147ms (SLO: <20.500ms 📉 -11.5%) vs baseline: ~same Memory: ✅ 37.262MB (SLO: <53.000MB 📉 -29.7%) vs baseline: +5.0% ✅ record-exceptionTime: ✅ 39.233ms (SLO: <41.000ms -4.3%) vs baseline: -0.1% Memory: ✅ 37.787MB (SLO: <53.000MB 📉 -28.7%) vs baseline: +4.9% ✅ set-statusTime: ✅ 19.568ms (SLO: <22.000ms 📉 -11.1%) vs baseline: -0.2% Memory: ✅ 37.164MB (SLO: <53.000MB 📉 -29.9%) vs baseline: +4.6% ✅ startTime: ✅ 18.605ms (SLO: <20.500ms -9.2%) vs baseline: +4.9% Memory: ✅ 37.207MB (SLO: <53.000MB 📉 -29.8%) vs baseline: +4.8% ✅ start-finishTime: ✅ 53.006ms (SLO: <54.000ms 🟡 -1.8%) vs baseline: -0.1% Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.3% ✅ start-finish-telemetryTime: ✅ 54.545ms (SLO: <56.000ms -2.6%) vs baseline: ~same Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.7% ✅ start-finish-traceid128Time: ✅ 56.432ms (SLO: <57.000ms 🟡 -1.0%) vs baseline: -0.3% Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.8% ✅ start-traceid128Time: ✅ 18.197ms (SLO: <22.500ms 📉 -19.1%) vs baseline: -0.1% Memory: ✅ 37.181MB (SLO: <53.000MB 📉 -29.8%) vs baseline: +4.8% ✅ update-nameTime: ✅ 18.179ms (SLO: <22.000ms 📉 -17.4%) vs baseline: ~same Memory: ✅ 37.312MB (SLO: <53.000MB 📉 -29.6%) vs baseline: +5.2% 🟡 telemetryaddmetric - 27/27✅ 1-count-metric-1-timesTime: ✅ 3.329µs (SLO: <20.000µs 📉 -83.4%) vs baseline: +9.6% Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.8% ✅ 1-count-metrics-100-timesTime: ✅ 202.602µs (SLO: <220.000µs -7.9%) vs baseline: +0.1% Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.9% ✅ 1-distribution-metric-1-timesTime: ✅ 3.428µs (SLO: <20.000µs 📉 -82.9%) vs baseline: ~same Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.7% ✅ 1-distribution-metrics-100-timesTime: ✅ 214.056µs (SLO: <230.000µs -6.9%) vs baseline: -0.3% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.8% ✅ 1-gauge-metric-1-timesTime: ✅ 2.202µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +0.4% ✅ 1-gauge-metrics-100-timesTime: ✅ 135.707µs (SLO: <150.000µs -9.5%) vs baseline: -1.0% ✅ 1-rate-metric-1-timesTime: ✅ 3.186µs (SLO: <20.000µs 📉 -84.1%) vs baseline: -0.3% Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 215.748µs (SLO: <250.000µs 📉 -13.7%) vs baseline: +0.4% ✅ 100-count-metrics-100-timesTime: ✅ 20.475ms (SLO: <22.000ms -6.9%) vs baseline: +0.3% Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.7% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.258ms (SLO: <2.550ms 📉 -11.5%) vs baseline: +0.7% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.7% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.415ms (SLO: <1.550ms -8.7%) vs baseline: +0.5% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) ✅ 100-rate-metrics-100-timesTime: ✅ 2.229ms (SLO: <2.550ms 📉 -12.6%) vs baseline: +0.7% Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.0% ✅ flush-1-metricTime: ✅ 4.693µs (SLO: <20.000µs 📉 -76.5%) vs baseline: +0.4% Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.9% ✅ flush-100-metricsTime: ✅ 174.328µs (SLO: <250.000µs 📉 -30.3%) vs baseline: -0.3% Memory: ✅ 35.606MB (SLO: <36.000MB 🟡 -1.1%) vs baseline: +5.0% ✅ flush-1000-metricsTime: ✅ 2.180ms (SLO: <2.500ms 📉 -12.8%) vs baseline: +0.7% Memory: ✅ 36.274MB (SLO: <36.500MB 🟡 -0.6%) vs baseline: +4.9% 🟡 tracer - 6/6✅ largeTime: ✅ 30.318ms (SLO: <32.950ms -8.0%) vs baseline: +0.4% Memory: ✅ 36.294MB (SLO: <36.500MB 🟡 -0.6%) vs baseline: +4.9% ✅ mediumTime: ✅ 3.008ms (SLO: <3.200ms -6.0%) vs baseline: +0.2% Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +4.9% ✅ smallTime: ✅ 348.158µs (SLO: <370.000µs -5.9%) vs baseline: +2.8% Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +5.0%
|
Description
This PR adds APM and LLM Observability tracing for the Claude Agent SDK. We trace the
query,ClaudeSDKClient.query, andClaudeSDKClient.receive_messagesmethods.Testing
stand-alone query invocation
ClaudeSDKClient.query invocation